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jrt ' We consider the invariant measure of homogeneous random walks 

in the quarter-plane. In particular, we consider measures that can be 
expressed as an infinite sum of geometric terms. We present necessary 
conditions for the invariant measure of a random walk to be a sum 
of geometric terms. We demonstrate that each geometric term must 
individually satisfy the balance equations in the interior of the state 
space. We show that the geometric terms in an invariant measure 
fT^ I must have a pairwise-coupled structure. We further show that the 

CO ■ random walk cannot have transitions to the North, Northeast or East. 

^^ I Finally, we show that for an infinite sum of geometric terms to be an 

f^ . invariant measure at least one coefficient must be negative. This paper 

CO I extends our previous work for the case of finitely many terms to that 

of countably many terms. 
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1 Introduction 

Random walks for which the invariant measure is a geometric product form 
are often used to model practical systems. The benefit of using such models 
is that their performance can be easily analyzed with tractable closed-form 
expressions. However, the class of random walks which have a product form 
invariant measure is rather limited. Therefore, it is of interest to find larger 
classes of tractable measures that can be the invariant measures for random 



walks in the quarter-plane. In previous work we considered the measures that 
can be expressed as a linear combination of finitely many geometric terms [6] . 
In the current work we consider the case of countably many terms. 

We study random walks in the quarter-plane that are homogeneous in 
the sense that transition probabilities are translation invariant. Our interest 
is in finite measures m{i,j) that can be expressed as 

m{i,j)= ^ a(/9,cr)pV^ with |r| = oo, (1) 

i.e., m{i,j) can be expressed as an infinite sum of geometric terms. 

Contrary to much other work, for instance [TJ [9l [TTl [12], our interest is 
not in finding the invariant measure for specific random walks. Instead our 
interest is in characterizing the fundamental properties of random walks, 
sets r and coefficients a that allow an invariant measure to be expressed 
in form ([T]). The contributions of the current work are a set of necessary 
conditions: 

1. The elements of F must individually satisfy the balance equations in 
the interior of the state space. 

2. Consecutive elements of T must have a common coordinate, i.e., T 
must have a structure which we refer to as pairwise-coupled. 

3. In the interior of the state space, the random walk has no transitions 
to the North, Northeast or East. 

4. At least one of the coefficients a(p, a) in ([1]) must be negative. 

The balance equations in the interior of the state space induce an algebraic 
curve. A closely related curve arises as the kernel of the boundary value 
problems studied in [7113 ^^^ related work. Some of its basic properties were 
derived in [S]. An important part of the current work consists of studying 
this algebraic curve in more detail. Section [3] presents new results on the 
properties of this curve. 

Adan et al. [H [21 |3l U] use a compensation approach to construct an 
invariant measure that is an infinite sum of geometric terms. In particular, 
this is done for the random walk that have no transitions to the North, 
Northeast and East. In addition the geometric terms in the measure will 
individually satisfy the interior balance equations and negative weights will 
occur in the sum. In that sense, the results from [3j complement the necessary 
conditions that are obtained in the current paper. 

It is interesting to point out that the measures that are obtained in [3] can 
consist of multiple pairwise coupled sets and that these measures, therefore, 
do not satisfy our condition 2 mentioned above, which states that only a 
single pairwise coupled set can occur. There is no contradiction between 
these results, since the measure that is constructed in [3] is not finite. In fact, 
the only finite measures that have been constructed using the compensation 
approach consist of a single pairwise coupled set. Note, in addition that the 



random walks studied in [Il[2l|3ll3] do not satisfy our homogeneity conditions. 
We discuss these conditions and the relation to the compensation approach 
in more detail in Section [5j 

For the reflected Brownian motion in a wedge, the invariant measure that 
is a sum of finitely many exponentials was studied by Dieker et al. [8|. They 
show that for the invariant measure to be a linear combination of finitely 
many exponential measures, there must be an odd number of terms that 
have a pairwise-coupled structure. The method for the continuous state 
space Brownian motion, however, cannot be used for the discrete state space 
random walk. In [6j we investigated the invariant measure that is a sum 
of finitely many geometries for the random walk in the quarter-plane. The 
necessary conditions derived in the current paper form the natural extension 
of our results from [6] to the case of countably many terms. 

The remainder of this paper is structured as follows. In Section [2] we 
present the model. An important algebraic curve has been investigated in 
Section [3l The necessary conditions for the invariant measure of a random 
walk to be a sum of geometric terms are given in Section HI The conclusion 
is drawn in Section [5j 

2 Model 

Consider a two-dimensional random walk P on the pairs S = {{i,j),i,j S 
No} of non-negative integers. We refer to {{i,j)\i > 0,j > 0}, {{i,j)\i > 
0)J = 0}, {{i,j)\i = 0,j > 0} and (0,0) as the interior, the horizontal 
axis, the vertical axis and the origin of the state space, respectively. The 
transition probability from state {i,j) to state {i + s,j + t) is denoted by 
Ps,t{hj)- Transitions are restricted to the adjoining points (horizontally, 
vertically and diagonally), i.e., Ps,t{k, /) = if |,s| > 1 or \t\ > 1. The process 
is homogeneous in the sense that for each pair {i,j), {k,l) in the interior 
(respectively on the horizontal axis and on the vertical axis) of the state 
space 

Ps,^,]) =Ps,t{k,l) and ps^tii - s,j - t) = Ps,t{k - s,l - t), (2) 

for all — 1 < s < 1 and — 1 < t < 1. We introduce, for i > 0, j > 0, the 
notation Ps,t{i,j) = Ps,t, PsfiihO) = hs and po,t(0, j) = Vt- Note that the 
first equality of ([2]) implies that the transition probabilities for each part of 
the state space are translation invariant. The second equality ensures that 
also the transition probabilities entering the same part of the state space are 
translation invariant. The above definitions imply that pi^o(0, 0) = hi and 
Po,i(0,0) = Vi. The model and notations are illustrated in Figure [TJ 

We assume that the random walk is ergodic,i.e., irreducible, aperiodic 
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Figure 1: Random walk in the quarter-plane. 

and positive recurrent, and has invariant measure m, i.e., for i,j > 0, 

1 1 



'■{hj)= ^ ^m{i-s,j -t)ps,t, 

s=-lt=-l 

1 1 

{i, 0) = ^ m{i - s, l)ps~i + ^ m{i - s, 0)ps,o, 

s=-l s=-l 

1 1 

(0, i) = ^ m{l,j - t)p_i,i + Y^ m(0,i - t)po^f 



(3) 



t=-i 



i=-l 



The balance at the origin is implied by the balance equation for all other 
states. We will refer to the above equations as the balance equations in the 
interior, the horizontal axis and the vertical axis of the state space respec- 
tively. 

We are interested in the measures that are the linear combinations of 
positive geometric terms. 

Definition 1 (Induced measure). The measure m is called induced by T C 

(p,^)6r 
with a{p,a) G M\{0} for all {p,cr) € T. 

We are interested in finite measures, in which the sum does not depend 
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Figure 2: Examples of Q(x,y) = 0. 

Pi,o = i Po-i =P-i,i = I- 
[(d]]p_i,i =pi-i = \,p-i-i 





l) = 0. (a)|pi,o = Po,i = i, P-1,-1 = i- 
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(c) Pi,i = el'^P-i.i =1^1-1 = It'P-1-1 = 
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on the ordering of the terms. Therefore, we assume absolute convergence, 

V \a{p,a)\- <oo. (4) 

^-^ \ — p\ — (T 



(p,<^)er 



To identify the geometric measures that individually satisfy the balance 
equations in the interior of the state space, ([3]), we introduce the polynomial 



1 1 



Q{x,y) = xy{^^x^y ^ps,t - 1 



\s=-lt=-l / 

to capture the notion of balance, i.e., Q{p,a) = implies that m{i,j) = 
p^a^,i,j G S satisfies Q. Several examples of the level set Q{x,y) = 
are displayed in Figure [2l Let Q denote the set of real (x, y) satisfying 
Qix,y) =0, i.e., 

Q = {(x,y)GM2|Q(x,y) = 0}. (5) 

We are only interested in the properties of the algebraic curve Q{x,y) = 
in M^, where M^ = {{x,y)\x >0,y> 0}. We denote the subset oiQ(x,y) = 
in M^ by Q"^. Moreover, we denote the boundary of M^ by Rb where 
Rb = {{x,y) G M^lxy = 0}. Due to the requirement of a finite measure, 
we will be interested in U = {{x,y)\{x,y) E (0,1)^}. In addition to U, we 
introduce tJ = [0, 1)^. The properties of the algebraic curve Q{x, y) = will 
be studied first in Section [3j 



3 Algebraic curve Q in IR^ 

In this section we will analyze the algebraic curve Q in M^. Fayolle et 
al. [9j have extensively studied the algebraic curve that is defined through 
^y(X^s=-i X^t=-i ^^lfPs,t — 1) = and arises from studying the generating 
function of the invariant measure. We study the polynomial Q{x,y) that 
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Figure 3: Singular random walks: non-zero transitions in the interior of the 
state space. 



arises naturally from the balance equations. It is clear that the properties 
that are derived in |^ can be related to the properties of Q(x,y) by con- 
sidering Pi J = p-i-j. In this section we will present some of the results 
from [9j that will be useful in the sequel as well as a number of new results. 
The results from [9j are mostly algebraic of nature. The new results that we 
present deal with the geometry of Q. 

First, following [9] we define the notion of a singular random walk. 

Definition 2 (Singular random walk). Random walk P is called singular if 
the associated polynomial Q{x, y) is either reducible or of degree 1 in at least 
one of the variables. 

In the remainder we will often distinguish between singular and non- 
singular random walks. In addition we will analyze the singularities of curve 
Q, which is defined in the usual way below. Note that the two notions are 
not related; it is, for instance, possible to have a non-singular random walk 
for which Q has a singularity. 

Definition 3 (Singularity of Q). Point {x,y) £ Q is a singularity of multi- 
plicity m, m > 1, iff at {x,y) all partial derivatives of Q{x,y) of order less 
than m vanish and at least one partial derivative of order m is non-zero. 

The following result characterizes singular random walks in terms of their 
transition probabilities. 

Lemma 1 (Lemma 2.3.2 [9]). Random walk P is singular if, and only if, 
one of the following conditions holds: 

1. There exists {i,j) S 1? , \i\ < 1, \j\ < 1, such that only pi_^ and 



^«j 



P-i-j are different from, (see Figure 3(a) and the other three cases 
obtained by rotation); 

2. There exists i, \i\ = 1, such that for any j, \j\ < 1, pij = (see 
Figure \3(b)\ and Figure 3(c) ); 

3. There exists j, \j\ = 1, such that for any i, \i\ < 1, pij = (see 
Figure \3(d)\ and Figure 3(e)). 



The algebraic results that we use from 01 are defined in terms of the 
branch points of the multi-valued algebraic functions X{y) and Y{x) which 
are defined through 

QiX{y),y)=Q{x,Y{x)) = 0, 

for x,y G C. First, observe that by reordering the terms in Q{x,y) = we 
get 

1 1 1 

( E y''^'p-i,s)^' + ( E y'^^Ws -y)x + {J2 y^'+^M) = o. (6) 

s=— 1 s=— 1 s=— 1 

Therefore, the branch points of X(y) are the roots of Ax{y) = where Ax{y) 
is defined as 

1 11 

Ax(y) = ( E y~'''Ws - y? - 4( E y"'+VM)( E y^'^V,.)- (7) 

s=— 1 s=— 1 s=— 1 

In similar fashion, by rewriting Q{x,y) = into 

1 1 1 

( E x-*+Vt,-i)y' + ( E ^'*''V,o - x)y + ( E ^"*+V,i) = 0, (8) 

i=-l t=-l t=-l 

it follows that the branch points of Y(x) are the roots of Ay(x) = where 
Ay{x) is defined as 

1 11 

A,(x) = ( E ^"'-^Vo - xf - 4( ^ x-*+V,-i)( E ^"*^V,i). (9) 
t=-i t=-i t=-i 

Next, we present two lemmas that fully characterizes the location of the 
branch points of Y{x) and X{y) in terms of the transition probabilities of 
the random walk. These results provide us with the opportunity to connect 
the geometry of Q with the interior transition probabilities. The first lemma 
presented below follows from Lemmas 2.3.8-2.3.10 of [9j. The result readily 
follows if one takes into account that in the current paper we consider only 
ergodic random walks, whereas [9] also allows for non-ergodic random walks. 

Lemma 2 (Lemma 2.3.8-2.3.10 |9J). For all non-singular random walks 
such that My ^ 0, Y{x) has four real branch points. Moreover, Y{x) has 
two branch points xi and X2 (resp. X3 and X4) inside (resp. outside) the unit 
circle. 

For the pair (2:3, 3:4), the following classification holds: 

1. i/p_i^o > "^JP-i-iP-i,!} then X3 and X4 are positive; 

2. if p-ifi = 2y/pZi~IipZi^, then one point is infinite and the other is 
positive, possibly infinite; 



3. if P-ifl < 2^/p^^i~ifK^iJ, then one point is positive and the other is 
negative. 

Similarly, for the pair (xi,X2), 

1- if Pi,0 > '^\/Pi,-iPi,i' ^^c'^ ^1 '^''T'd X2 are positive; 

2- if Pifl = '2yJPi-iPi,i, then one point is and the second is non- 
negative; 

3- if Pi.o < '2jP\-\P\,\j then one point is positive and the other is neg- 
ative. 

For all non-singular random, walks for which My = 0, one of the branch 
points ofY{x) is equal to 1. In addition, 

1. if Mx < 0, then two other branch points have a modulus bigger than 
1 and the remaining one has a modulus less than 1; 

2. if Mx > 0, then two branch points are less than 1 and the modulus of 
the remaining one is bigger than 1. 

Furthermore, the positivity conditions are the same as the case when My ^ 0. 
This lemma is true also for X{y), up to a proper symmetric change of the 
parameters. 

The next lemma deals with multiplicity of the branch points. 

Lemma 3 (Lemma 2.3.10 [9j). The branch points of X{y) and Y(x) with 
multiplicity 2 occur only at 0, 1 and oo. 

The final result of [9] that we need characterizes ergodicity of a random 
walk in terms of the drift in the interior and along the boundaries of the 
state space. Let us first define the drift of the random walk P as M, M and 

M . 



M = iMx,My) = ( Y^ pi^t - Yl p-i.*' Yl p^.i - Yl p^.-i)' 

i=-l i=-l s=-l s=-l 

1 
M' = (M;, M;) = (/ii + pi,i - h-i - p-i,u J2 Ps,i), 

s=-l 
1 

M" = (M^, m;') = ( J] Pi,t, VI + pi,i - f-i - pi,-i). 
t=-i 

Theorem 1 (Theorem 1.2.1 [9j). Consider an irreducible aperiodic random 
walk P, when M ^ 0, the random walk is ergodic if and only if one of the 
following three conditions holds: 
1. 

' M^ < 0, My < 0, 

M^Mi^ - MyM'x < 0, 

[MyM;^ - Mxm;; < 0; 



2. M^ <0,My> 0, MyM!^ - M^M^ < 0; 

3. M^ >0,My < 0, M^M^ - MyM'^ < 0. 

It will be shown that when M = 0, which means the drift of the random 
walk is zero, the algebraic curve Q~^ reduces to a single point (1, 1). There- 
fore, it is impossible to have sum of geometric terms invariant measure for 
the random walks with zero drift. Hence, the random walk with zero drift 
is of minor importance in our paper. The remainder of this section is re- 
lated to new results on the geometry of Q. First, we investigate the possible 
intersection of Q and Rb where Rb is the boundary of the first quadrant. 

Lemma 4. Consider a non-singular random walk P. If {x,y) G Q n R^ 
then either x > {) and y > or x = y = 0, i.e., Q cannot cross Rb except in 
the origin. 

Proof. If (x, y) is the intersection of Q and x = 0, then y must be the root 
of the following quadratic equation, 

Pi-iy^ + PifiV + Pi,i = 0. (10) 

We now show that the roots of (|10p are non-positive by considering all pos- 
sible choices of pi^_i,pi^o and pi^i. If pi^_i 7^ 0, then (I1U|) has either no root 
or two non-positive roots by investigating the relations of the roots using 
Vieta's formulas. If pi-i = and pi^ 7^ 0, then (jlOp has one non-positive 
root. If pi^_i = pifi = and pi^i 7^ 0, then (|10p has no root. The random 
walk with pi-i = pifl = pi^i = is excluded because it is singular. In simi- 
lar fashion it follows that Q(x,y) = can only intersect y = when x < 0. 
Therefore, the only possible intersection of Q and Rb is the origin. D 

Now we characterize the number of connected components in the first 
quadrant. 

Lemma 5. Consider a non-singular random walk P with non-zero drift. The 
connected components are closed. The algebraic curve Q has one and only 
one connected component in M^. Moreover, this connected component has 
non-empty intersection with the unit square U . 

Proof of Lemma\^ First observe that because of the continuity of functions 
^x{y) and Ay(x) defined in ([7]) and ([9]), respectively, the connected com- 
ponents are closed. This means, for each line in R^ that the multiplicity 
of the intersection of this line and a connected component is either two or 

zero. It can readily be verified that (1, 1), (1, i°"~^ °'^ ) and { -^"^^ ^'' , 1) 

are on Q. Therefore, there is at least one connected component in the first 
quadrant. 



The ergodic conditions for the random walk with non-zero drift from 
Theorem [1] imply that one of the following requirements must be satisfied, 

0< ^}=-^P''' <l, 0< ^l=-^P''' <i. (11) 

Without loss of generality, let us assume < ^""""^ < 1. If (1, 1) 

Z^a = -lPs,-l 

and (1, i^~~"^ °' ) are on different connected components, then these two 

components must be completely contained in x < 1 and x > 1 respectively, 
due to the closedness of the component and degree of Q. However, in that 
case, two of the branch points of Y{x) are equal to 1 which contradicts 

Lemma [2l Therefore, (1,1) and (1, ^/"~^ "' ) are on the same connected 

component. 

We have Ay(l) 7^ 0, due to the continuity of Ay{x), the connected com- 
ponent containing (1, 1) must extend to both the inside and outside of the 
unit square U. If Q contains only one connected component, this connected 
component must be in M^ because Q can only intersect Rb at the origin. 

It still remains to show that Q contains a single connected component in 
M^. If Q would contain multiple connected components in M^, by using the 
property that the multiplicity of the intersections of any horizontal or vertical 
line and Q(x,y) = is at most two, we can conclude there are three branch 
points either inside or outside the unit square, which contradicts Lemma [2j 
Therefore, there is one and only one connected component of Q in the first 
quadrant and it has non-empty intersection with U. D 

Remark: When the drift of the random walk is zero, the unique connected 
component in the first quadrant reduces to point (1, 1), see Section 6.5 [9J. 

Now we know that Q^ , the intersection of Q{x,y) = and M^, is a 
connected component. Denote the branch points of Y(x) and X(y) on Q^ 
by xi,Xr with xi < x^ and yb,t/i with y^ < yt respectively. Let yi,yr,Xb,Xt 



satisfy {x I, yi), {xr,yr), {xt,yt), {xb^Vb) £ Q, see Figure |4(a)] We wih refer to 
{xi,yi), {xr,yr), {xt,yt), {xb,yb) as branch points of Q"*". From Lemma [21 we 
know that < Xi < 1 < Xr, < yb < 1 < yt- Since we are only interested 
in finite measures, we only consider Q^ in U. Recall from Section [2] that 
U = [0, 1)^. Lemma [5] states that Q'^ = Q~^ CiU is a non-empty set for an 
ergodic random walk with non-zero drift. We first start the analysis of Q^ . 

Definition 4 (Partition of Q"^). The partition {Qoo,Qo1iQiOjQii} of Q^ 
is defined as follows: Qqq is the part of Q connecting {xi,yi) and {xb,yb); 
Qio is the part of Q connecting {xb,yb) CL^d {xr,yr); Qoi ^s the part of Q 
connecting {xi,yi) and {xt,yt); Qii is the part of Q connecting {xr,yr) oind 
{xt,yt)- 

10 
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Figure 4: Q'^ for the random walk from Figure 2(c) (a) Branch points of 
Q+.[(b)]Partitionof Q+. 
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Figure 5: Types of real double point, (a) crunode. |(b)| acnode. (c) ordinary 
cusp. 



An example of the partition of Q^ is illustrated in Figure |4(b)[ The 
monotonicity of X(y) and Y{x) plays an crucial role in analyzing the pairwise- 
couple set with infinite cardinality, therefore we analyze it here. 

Lemma 6. Consider {x,y) £ Qi^i-i and {x,y) £ Qi,i~i where i = 0, 1, if 
X > X, then y > y. Consider {x,y) G Qj^j and (x,y) G Qi^i where i = 0,1, if 
X > X, then y < y. 

Proof. We only consider Qoi- The proofs for the other cases follow analo- 
gously. Assume {x,y),{x,y) £ Qoi and x > x, ii y < y, then there exists 
{p,a),{p,a) G Qoi such that a = a. However, there also exists another 
geometric term (p, a) G Qio U Qn such that a = a. This contradicts that 
the multiplicity of the intersection of any horizontal line and Q is at most 
two, which completes the proof. D 

Next, we turn our attention to the singularity of Q, as defined in Defini- 
tion 131 We will see below that if one set from the partition of Q^ is empty, 
then the curve Q^ will have a singularity. The singularity plays an important 
role in the analysis later. 
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Lemma 7. For all non-singular random walks with non-zero drift, (x, y) is 
a singularity of Q"*" if and only if it is a crunode of order 2 and x and y are 
branchpoints of multiplicity 2 ofY{x) and X{y) respectively. 

Proof. We prove by contradiction that it is not possible to have singularity 
of order larger than 2. Suppose that (x, y) G Q^ is a singularity of order 
larger than 2. From Lemma U] it follows that we need to consider the cases 
i) X > and y > 0, and ii) (x, y) = (0, 0). If x > and y > it follows from 

d'^Q{x,y) ^-^ _t+i d'^Q{x,y) ^-^ _^+i 

Q2^ = 1^ P-hty + = 0, and g2^ = 2^ Ps,-ix + = 0, 

that p-1,1 = P-1,0 = P-1,-1 = Po-i = Pi,~i = 0, which leads to a non- 
ergodic random walk. For (x, y) = (0, 0) it follows from 

Q Q(x y) 

— — — ^ — = 4xyp_i _i + 2xp_i,o + 22/po -1 + Po,o -1 = 0, 
oxoy 

that Poo = li which leads to a random walk that is not irreducible. This 
concludes the proof that a singularity has at most order 2. 

Next, we demonstrate that if (x,y) is a singularity, then x and y are 
branch points of Y{x) and X{y) respectively. By combining Q{x,y) = 
with 



dQ{x,y) 
dx 

we obtain 



1 



2x( Y, p-i,ty-'^^) + ( Yl Po,i2/-*+' -y) = o 



t=-i 



1 



E P-i,ty''^'x' = E Pi,ty-'^\ 



t=-i t=-i 

which means x is the root of Ay(x) = 0, defined in ([9]) and therefore a branch 
point of Y{x). Similarly, it follows from Q{x,y) = and dQ{x,y)/dy = 
that y is a branch point of X{y). 

Now, we are ready to prove that a singularity (x,y) is a crunode. We 
refer the reader to any source on algebraic curves for a classification on 
singularities, for instance |10j . An illustration of all possible singularities 
of order 2 is given in Figure \5\ Note, that the figure does not include a 
ramphoid cusp, since it has order larger than 2. A singularity cannot be 
an ordinary cusp, because x and y are branch points of Y{x) and X{y) 
respectively. Moreover, (x, y) is not an acnode because Q^ is non-empty 
due to Lemma [5j Therefore, a singularity is a crunode. 

The final result in this lemma follows from the observation that if x and 
y are branch points of Y(x) and X{y) respectively and (x,y) is a crunode 
then X and y must have multiplicity two. D 
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Lemma 8. The algebraic curve Q has a singularity in U if and only if 
Po,i = Pi,i = Pi,0 = 0, in which case it is located in the origin. 

Proof. Lemma [7] states that (x, y) is a singularity of Q^ if and only if it is a 
crunode of order 2 and x and y are branch points of multiplicity 2 of Y{x) 
and X{y) respectively. Therefore, we only need to consider {x,y) where x 
and y are the multiple roots of Ay(x) = and A^iy) = respectively. A 
multiple root of Ay(x) = and A^(y) = can only occur at x = 0, 1 or 
oo and y = 0, 1 or oo, respectively, due to Lemma [3l Therefore, x = and 
y = must be multiple roots of A.y{x) = and Ax{y) = 0, respectively, if 
there is a singularity in U. We know from [9l Lemma 2.3.10] that Ay{x) = 
has the multiple root at if and only if one of the following holds: 

P-1,0 = P-1,1 = POA = 0, (12) 

Pi,o = Pi,i = Po,i = 0, (13) 

P-i,-i=Po,-i=Pi,-i = (14) 

and A^,. (y) = has the multiple root at if and only if one of the following 
holds: 

Po-i=Pi,~i=Pi,o = 0, (15) 

Po,i = Pi,i = Pi,o = 0, (16) 

p^i_i=p_iQ=p_ii = 0. (17) 



Conditions ()14p and ()17p are excluded because either of them will lead to a 
singular random walk. The combinations of conditions (|12p and (|15p . (|12p 
and (fT6|) . ()13p and (jlSp will lead to singular random walks as well. Therefore, 
the algebraic curve Q has a singularity in U if and only if po,i = Pi,i = Pi,0 = 
0, in which case it is located in the origin. D 

4 Constraints to invariant measures and random 
walks 

In this section, we will first characterize the structure of the candidate set 
of geometric terms which may lead to an invariant measure. Then we will 
provide necessary conditions on the transition probabilities of a random walk 
to allow for an infinite sum of geometric terms to constitute the invariant 
measure. Finally, we demonstrate that it is necessary to have at least one 
negative coefficient in an invariant measure that is an infinite sum of geo- 
metric terms. 
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Figure 6: Partitions of set F. |(a)| curve Q+ of Figure 2(d) and F C Q^ as 
dots, [(b)] horizontally uncoupled partition with 6 sets, (c) vertically uncou- 
pled partition with 6 sets . | (d) | uncoupled partition with 4 sets. Different sets 
are marked by different symbols. 



4.1 Uncoupled partitions 

The proofs in this and subsequent sections are based on the notion of un- 
coupled partitions, which is introduced first. 

Definition 5 (Uncoupled partition). A •partition {Fi,F2,---} o/F is hor- 
izontally uncoupled if (/o, cr) G Fp and, [p, a) G F^ for p ^ q, implies that 
p i^ p, vertically uncoupled if (p, a) G Fp and {p, a) G Tg for p ^ q, implies 
a ^ a, and uncoupled if it is both horizontally and vertically uncoupled. 

We call a partition with the largest number of sets a maximal partition. 

Lemma 9 (Lemma 1 |6j). The maximal vertically uncoupled partition, the 
maximal horizontally uncoupled partition and the maximal uncoupled parti- 
tion are unique. 

Examples of a maximal horizontally uncoupled partition, of a maximal 
vertically uncoupled partition and of a maximal uncoupled partition can be 
found in Figure [6j Let H denote the number of elements in the maximal 
horizontally uncoupled partition and F^, p = 1,. . . ,H, the sets themselves, 
where elements of Fp have common horizontal coordinate /9(Fp). The max- 



imal vertically uncoupled partition has V sets, F^, 



1, 



, V, where 



elements of F^ have common vertical coordinate a{T^). The maximal un- 



coupled partition is denoted by {F^}^^ 
infinite. 



1- 



The H, V, U are allowed to be 



4.2 Constraints to set F 

Before we analyze the structure of the candidate set of geometric terms which 
may lead to an invariant measure, we present some results from |5] in our 
notation for a special case. 
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Theorem 2 (Theorem 1, Lemma 1 |5]). Consider a real measure ji{p) with 
the hounded compact support K . If 



P{p) dp{p) = (18) 

for all polynomials P, then /i = 0. 

We first show that only the sum of geometric terms chosen from Q^ may 
lead to the invariant measure for a random walk. 



Theorem 3. If the invariant measure for a random walk in the quarter-plane 
is induced by F C M^, then F C Q^. 

Proof. Since m satisfies balance ([3]) in the interior of the state space, i.e., 
{i,j) with i > and j > 0, 

1 1 

{p,o-)Gr s=~it=-i 

Let j = 1, we will get an infinite system of equations when i = 1, 2, • • • , 

oo 1 1 

E(^(r,^)r'[ E «(p,a)(pa- ^ j;pi-v-W] = o. (19) 

p=i (p,'^)6rh s=-it=-i 

Similarly, let i = 1, we will get another infinite system of equations when 

oo 1 1 

(/=i (p,':r)er^ s=-it=-i 

The absolute convergence of {a{pk, CFk){pkCk - Yls=-i Ylt=-i Pk'''^k''Ps,t)}, 
where k = 1,2,- ■ ■ and {pk, Ufc) E F will be shown here. Because of assump- 
tion dH), i.e., the absolute convergence of the terms of which the sum is m, 
we have 

oo 1 1 

^\aipk,crk)ipkcrk- Yl Y Pk''^k'^P'^'t)\ 
k=l s=-lt=-l 

oo ^ ^ 

<S V|a(pfc,o-fc)|- 

^^ I - Pkl - I 



k=l - p'^'-^'^ 



<oo, 
where i? is a finite positive constant. We define a real measure p as 



Kp) = { 



for pe{piF^l),p{F^),---}, 
otherwise. 
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We can now write (fT9l) as 



p=i -^ 

for i = 1,2,3- ■■ . This indicates that 

P{p) dfi{p) = 



for ah P{p) = p^ where j = 0, 1, 2 • • • . Hence J P{p) dp[p) = for ah poly- 
nomials. Moreover, for p = 1,2,---, the sequence Ylin u^&V^ ^iP^^)iP^ ~ 

Ss=-i St=--i P^ *^^ Vs,t) is absolutely convergent. Hence, the compact 
support of this sequence is a bounded interval. Therefore, by using The- 
orem El ^ = 0, i.e., E(p,a)er^"(/^'^)(/'^ " Y.\=-iY.\=-iP^~''^^~*Ps,t) = 
0, for p = 1,2,- ■ ■ . In similar fashion, we obtain for q = 1,2,---, that 
E(p,a)Gr^ "(Z^' '^)(/'^ - EL-1 Et=-i P^~''<^^'^Ps,t) = 0, These two solutions 
guarantee that pkCFk - Yjs=-iYjt=-i Pk'"' ^k~*Ps,t = 0, for k = 1,2, 3--- , 
which is the interior balance equation for the measure m = p^cr-j^, hence 
Q{p,a) = for {p, a) eV. D 

We now make two observations on the structure of T C Q^j for which 
the maximal uncoupled partition consists of only one set. Firstly, for any 
(/O, o") E r there always exist either (p, a) E F, with a 7^ o" or (p, a) E F with 
p ^ P- Secondly, the degree of Q{p,a) is at most two in each variable. This 
means, for instance, that if (p, o") E F and (p, a) GT, a ^ a, then there does 
not exist (p, a) E F, where a ^ a and a ^ a. By repeating the above two 
arguments for other elements in F it follows that F must have a pairwise- 
coupled structure. An example of such a set is F = {(/5fc, o"fc), A: = 1, 2, 3 • • • }, 
where 

Pi = P2,Cri > (T2,P2 > P3, 0"2 = CTS, P3 = PA, CTs > 0-4, • • • . (20) 

The above discussion leads to the definition of a pairwise-coupled set in terms 
of the number of sets in a maximal uncoupled partition. 

Definition 6 (Pairwise-coupled set). A set F C Q^ is pairwise-coupled if 
and only if the maximal uncoupled partition of F contains only one set. 

We are now ready to show that if there are multiple sets in the maximal 
uncoupled partition of F, then the measure induced by this F cannot be the 
invariant measure. We first introduce some additional notation. For any set 
Fp from the maximal horizontally uncoupled partition of F, let 

1 

^'(r;j)= E «(p,^)[E ('°'"'^-+'°'~'^p^.-l)-p]• 
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For any set T^ from the maximal vertically uncoupled partition of T, let 

1 

(p,<7)Gr- t=-i 

Theorem 4. Consider the random walk P , if the invariant measure m of 
P is m{i,j) = "^(p ^)^-p o:{p,o')p^(T^ , then T is pairwise- coupled and for all 

p, qe {1,2,3,- ■■ }, B\T^) = and S-(rp = 0. 

Proof. Since m is the invariant measure of P, m satisfies the balance equa- 
tions at state (i, 0) for i = 1, 2, 3 • • • . Therefore, 

1 
= 2, \jn{i — s, 0)hs + m{i — s, l)ps-i] — m{i, 0) 

s=-l 

1 

= Yl a{p,a)[J2{p"'hs + p'~'<TPs,-i)-p'] 
(p,(T)gr s=-i 

oo 1 

p=i (p,o-)Gr^ s=-i 

oo 

=Yp(^iy''B\r^,). (21) 

We now show the absolute convergence of sequence {B^lTp)} for p = 1, 2, 3 • • • 
Because of the assumption that m{i,j) is a finite measure, we have 



E \B\Tl 



-pj 
p=l 

cc 1 



<E"('^'='^'^^[E ^Pk '^s + p\ 'aps-i)-pk] 

fc=l s=-l 

<oo, 

the last inequality holds due to the same reasoning that is in the proof of 
Theorem [3j If we define a real measure p as 

^,[p) = {^'^^') If P = piny 

1 otherwise. 



We can now write (|2T]) as 



YiPiTir' p{p{Ti))) = / {p{Ti)r-Up{p{Ti)) = 0, 
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for ^ = 1, 2, 3 • • • . This indicates that 



L, ^, 



P(p)d/x(p)=0 

for all P{p) = p^ where j = 0, 1,2---. Hence J P{p) dfi{p) = for all 
polynomials. Moreover, the sequence {B (Tp)} for p = 1,2, • • • is absolute 
convergent. Therefore the compact support of this sequence is a bounded 
interval. Hence, by using Theorem[2]we have p = 0, which means B (Tp) = 
for p = 1, 2, • • • . Similarly, we can obtain that B'"{Tq) = for q = 1,2,- ■ ■ . 
These two results imply that F is a pairwise-coupled set. D 

4.3 Constraint to random walks 

In this section, we characterize the random walks of which the invariant 
measure may be an infinite sum of geometric terms. We will show that the 
existence of transitions to north, northeast or east plays an essential role in 
distinguishing such kind of random walks. 

The next result explains that it is not possible to have an invariant mea- 
sure that is an infinite sum of geometric terms for singular random walks. 

Theorem 5. // the invariant measure of a singular random walk is of the 
form m{i,j) = E{p,a)erP'^^ ^^e'^ |r| = 1- 

Proof. If the invariant measure of a singular random walk is of the form 
m{i,j) = X](po-)gr P*^"'' then |r| < 2 by using Theorem 2] and Lemma [TJ 
Furthermore, we have shown in [6] that the linear combination of two geo- 
metric terms cannot be the invariant measure for any random walk, which 
completes the proof. D 

We now focus on non-singular random walks. The next theorem applies 
Lemma [8] to non-singular random walks. 

Theorem 6. Let the invariant measure of the non-singular random walk P 
be m{i,j) = X](p,<T)Gr a{p,a)p'a^ with |F| = oo. Then pi^ = pi^i = po,i = 
and F has a unique accumulation point in the origin. 

Proof. We will demonstrate that in the absence of singularities it is not 
possible to have an invariant measure m{i,j) = 'Yl(pa)&"^iP^'^)P^'^'' with 
|F| = oo. More precisely, we show that F must have a singularity of Q as an 
accumulation point. The result of the theorem then follows, by Lemma [HI 
that states the algebraic curve Q has a singularity in U only if pi,o = Pi,i = 
Po,i = 0, in which case it is in the origin. 

Suppose that Q"*" does not contain any singularities and that m{i,j) = 
Ylip(T)&r^iPi^)P^^'' with |F| = oo is the invariant measure of P. In the 
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Figure 7: Different partition of Q^ for the random walk in Figure 2(c) 



remainder of this proof we will obtain a contradiction by showing that at 
least one of the terms (p, cr) G F will be outside the unit square and that the 
measure m{i,j) can, therefore, not be finite. 

Assume Xb < Xt, another possible case can be analyzed similarly. To 
simplify the presentation we introduce additional notation. Let {Qi, Qc, Qr} 
denote a partition of Q^, where 

Qi = {ix,y) £Q^ \x< Xb} , 
Qc= {ix,y) £ Q^ \ Xb < X < Xt} , 
Qr = {ix,y) G Q^ \ X > Xt} . 

Moreover, denote the two pieces of Qc by Q* ^^'^ Qc satisfying y > y \i 
{x,y) E Qc and {x,y) G Q}.. Since there are no singularities Qi,Qc and Qr 
are all non-empty. In addition, we let {Fi, . . . , F^} denote a partition of F, 
where the elements of Fj are denoted as Fj = {(/Oi.i,crj^i), . . . , {pi^L(i),'^i,L{i))} 
and each Fj satisfies 

Pi,l > Pi,2, <^i,l = 0"i,2, 

Pi,2 = Pi,3, (^i,2 > 0"i,3) 

Pi,3 > PiA^ <^i,3 = <7j,4, (22) 



In addition the partition {Fi, . . . , Fx} is maximal in the sense that no FjUFj, 



i ^ j satisfies (j22]) . In the remainder we will show that K < oo and that 
L{i) < oo for all i = 1, . . . ,K, leading to a contradiction to the assumption 
that |F| = cxD. 

First, we prove L{i) < oo by demonstrating that 

|FinQi|<l, |FinQc|<oo, |FinQ,.|<l. 

Suppose |FjnQ.f| ^ 2, then there exists {p,cr) and (/J, cr) on Qu or Qio 
satisfying a = a, which contradicts to Lemma [6j Therefore, |Fj n Qr\ < 1- 
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Similarly, we have \Ti D Qi\ < 1. Next, observe that since Q^ does not have 
any singularities, there exists a constant D > such that the distance of 
Q* and Q^ is at least D. This implies that for three consecutive elements in 

Pi,j > PiJ+1) (^ij — '^J,i+li 

Pi,j+1 = Pi,j+2, ^i,j+l > ^i,j+2i 

we have 0"jj_|_2 < (Jij — D. Therefore, iFj n Qd < oo. 

Next, we prove K < oo. More precisely, we will show that K < 2. 
Without loss of generality, we assume K = 3 and |rj| > 2. Observe that 
{ri,r2,r3} forms a pairwise-coupled set. Using from the above that |rj| < 
cx) for i = 1,2,3, we must have pi^^i) = P2,L(2) with Pi,l(i),P2,l(2) ^ Qi 
and p2,i = P3,i with p2,i,P3,i G Qr after a proper ordering of {ri,r2,r3}. 
Moreover, one of p2,i and p^^i must be on Qu- However, together yt > 1 
and Xr > 1 due to Lemma [2] and the monotonicity of Qu from Lemma [6l 
we conclude that Qu is outside of U, which contradicts that T C Q^ from 
Theorem [3j D 

4.4 Constraints to the coefficients 

The last section was devoted to finding the constraint to the random walk in 
which the pairwise-coupled set with infinite cardinality could be obtained. 
In this section, we show that it is necessary to have a geometric term with 
negative coefficient in the linear combination of infinite geometric terms. 

Theorem 7. // the invariant measure of the non-singular random walk P 
is m{i,j) = J2(p (7)er ^(.P^^)P^'^'' > where T C Q^j, \T\ = oo and a{p,a) G 
M\{0}, then at least one a{p,a) is negative. 

Proof. We know from Theorem [6] that pi^ = pi^i = po,i = in random walk 
P. Without loss of generality we consider F which is of the form given in (j20p 
and assume that a{pi,ai) = 1. Since measure induced by T is the invariant 
measure, it follows from Theorem [J] that B^{Tp) = and B'"(r'^) = for 
all p,q ^ {1,2,3,- ••}. Note that B^{{pi,ai),{p2,<72)} = indicates that 
a{p2,cr2) is uniquely determined by 



T 

a{p2,cr2) = -—a{pi,ai), 
J2 



where 



Ti = {I )/ii + (1 - Pi)h-i + ^ ps,i - ai{ ^ p- "ps-i)- 

P^ s=-l s=-l 

Next, a(/03,(T3) follows from i?^{(p2)0"2)) (P3)'73)} = 0. In similar fashion, 
for A;e{l,2,3,---}, 

Oi{p2k,(T2k) = - „" a{p2k-i,(^2k-i) where p2k = P2k-i,(^2k < (T2k-i- 

-t2fc 
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The following two facts allow us to show that there exists a positive integer 
N such that "^'^ > when k > N. First, we know piQ = pn = Poi =0 
and limfc_j.oo Pk = from Theorem [6j Secondly, the ergodic random walk 
with no drift to northeast requires hi + pi-i ^ 0. Note 



t2fc-l 



(^ ~ pir)^! + (1 - P2k-l)h-l +p-l,l - Cr2k-l{T,]=-i P2k-lPs-l) 



^2fc (1 - ■^)hi + (1 - p2k)h-l + p^i,i - (r2k{T,l=-lP2kPs-l) 

By using L'Hospital's rule, we can conclude 



1- T2k-1 

lim 

fc-i-oo T2k 



'll+0"2fePl,-l ' J- ^ ' /^i, i ^ ) 

1, if /ii / 0, pi,_i = 0; 



^2k 



rp 

The non-negativity of 1^~^ when k is large enough completes the proof. D 

5 Conclusion 

In this paper, we have obtained necessary conditions for the invariant mea- 
sure of a random walk to be an infinite sum of geometric terms. Firstly, 
Theorem [3] says that each geometric term in the linear combination must 
satisfy the interior balance equation. Secondly, Theorem |5] indicates that 
only a measure induced by a pairwise-coupled set may yield an invariant 
measure. Thirdly, Theorem [6] shows that the invariant measure may be an 
infinite sum of geometric terms only if there are no transitions to the North, 
Northeast or East. Finally, Theorem [7] requires at least one of the coefficients 
in the linear combination to be negative. 

As mentioned in the introduction, the random walks studied by Adan et 
al. for the compensation approach do not satisfy our homogeneity conditions. 
In particular, the second condition in ([2]) is not satisfied. We believe that 
our results also apply for this larger class of models. This would imply that 
the general structure of multiple pairwise coupled set that is provided by 
the compensation approach would reduce to a single pairwise coupled set if 
one insists on having a finite measure. The extension of the results from the 
current paper to the more general class of random walks is, unfortunately, 
outside the scope of the current work. 
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